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No. 09/474,031, filed on December 28, 1999; and "METHOD FOR SELECTING A 
RESTORATION PATH IN A MESH NETWORK," Serial No. 09/909,102, filed on July 19, 
2001 ; which are incorporated by reference herein. 




[0001] : ? The invention relates to telecommunications networks, and more particularly 
to restoration and normalization of a restored connection in a telecommunications 
network. 

[0002] Rapid recovery/restoration from network failures is a crucial aspect of 

current and futi/ref'teferommunication networks. Rapid restoration is required by 
transport network providers to support stringent Service Legal Agreements ("SLAs") that 
.dirtate high reliability and availability for customer connectivity. For example, and in 
the context of optical networking, Synchronous Optical Network (SONET) rings provide 
the primary technology for optical layer communication and restoration from network 
; "^.^.ralluS:^^^ 'SONEX'jrings tend to be capacity utilization inefficient when compared to 

"mesh" topologies in networks with a high degree of connectivity and when, because of 
size limitations, connections are forced to route through many interconnected rings. As 
_\ ; optical-cross connects (OXCs) are deployed within today's transport networks based on 
wavelength-division multiplexing (WDM), the potential emerges to provide on-demand 
' h ^!!!:es\k^Kjii^f^ high-bandwidth connections (also referred to in the art as "lightpaths" 
^or 4aEe^^ standards^such as Generalized MPLS 





("GMPLS"), also referred to in the art as Multi-Protocol Lambda Switching 
("MPL(ambda)S"), can provide a standardized optical network control plane that is 
essential for building an effective platform for vendor interoperability. See, e.g., D. 
Awduche et al., "Multi-Protocol Lambda Switching: Combining MPLS Traffic Engineering 
Control with Optical Crossconnects," IETF Internet Draft, http://www.ietf.org/internet- 
drafts/draft-awduche-mpls-te-optical-Ol.txt (November 1999). Unfortunately, few 
recent contributions to the art have addressed the need for fast failure restoration in 
such networks. GMPLS signaling proposals have primarily focused on the development 
of methods for label switched path ("LSP") establishment and removal — with limited 
fault recovery capabilities. In this specification, we will use the common terminology 
"LSP" for connection in transport network. 

[0003] The choice of a restoration policy is a tradeoff between network resource 

utilization (cost) and service interruption time. Clearly, minimized service interruption 
time is desirable, but schemes achieving this usually do so at the expense of network 
resource utilization, resulting in increased cost to the provider. Significant reductions in 
spare capacity can be achieved by sharing restoration capacity across multiple 
restoration paths whose service paths do not fail at the same time during independent 
failures. In co-pending commonly-assigned United States Utility Patent Application, 
"METHODS AND SYSTEMS FOR FAST RESTORATION IN A MESH NETWORK OF OPTICAL 
CROSS CONNECTS," Serial No. 09/474,03 1 , filed on December 28, 1 999, which is 
incorporated by reference herein, a restoration methodology is disclosed that utilizes 

restoration path disjoint from the normal service path — but wherein the 

>f - f cli^ may 6e chosen dynamically during the restoration process:. The: 

Invention therein disclosed, referred to by the inventors herein generally as "shared 
mesh restoration", can potentially provide restoration competitive with SONET ring 
restoration speeds. Co-pending commonly-assigned United States Utility Patent 
Application, "METHOD FOR SELECTING A RESTORATION PATH IN A MESH NETWORK," 
Serial No. 09/909,102, filed on July 19, 2001, which is also incorporated by reference 
herein, discloses a distributed approach to selecting the restoration path in a shared 
mesh restoratfoTrT^ 

Summary of Invention 

[0004] , The present invention is directed to methods for signaling that enable . 

bandwidth reservation, path restoration^ path normalization, and path removal in a 
mesh network that supports shared mesh restoration. The necessary network failure 
restoration functionality can be advantageously provided by extensions to existing 
signaling protocols such as RSVP-TE. In accordance with an embodiment of an aspect 
of the invention, shared resources along a restoration path are reserved by sending a 

y-<<}+: label 1 switched path request with a shared restoration flag indicating that the reserved 



restoration resources are not to be allocated. The request also includes service path 
information in order to permit sufficient but necessary restoration capacity reservation 
along the restoration path to recover any independent shared risk link group (SRLG) 
failures along the service path. The service path information can alternatively comprise 
a list of links used along the service path or a list of shared risk link groups traversed by 
the service path. The restoration path is setup, upon notification of a service path 
failure, by issuing a label switched path request allocating the reserved restoration 
resources. Deletion of a restoration path also requires specification of the service path 
information in order to de-allocate the resources allocated to the label switched path. 

[0005] Due to the sharing of restoration resources, it is necessary for a connection 

to return back to the service path after failure repair, which is referred to by the 
inventors as "restoration normalization." Then the released resources on the restoration 
path can be used to restore other failed service paths. The present invention is also 
directed to a novel method to accomplish the restoration normalization process within 
shared mesh restoration framework to achieve so-called "make-before-break" 
performance. A "bridge and roll" approach is disclosed for restoration normalization 
that advantageously permits minimal service traffic interruption. Also, it is preferable 
that the service path be verified prior to commencing the normalization process, and a 
verification procedure utilizing a protocol such as LMP is also disclosed. 

[0006] „ These and other advantages of the invention will be apparent to those of 

r : : \ ordinal the . 

accompanyihg drawings. vf k^-r'^ t ^ ^ - ^ 

Brief Description of Drawings 

[0007] FIG. 1 is a diagram of a label switched network, illustrating the sharing of 

restoration resources. 

[0008] r HCT^ of processing performed in resource reservation for 

restoration, in accordance with a preferred embodiment of an aspect of the invention. 

[0009] FIG. 3 is an illustrative format for a PATH message, supporting shared 

restoration resource reservation. FIG. 3A is an illustrative format for a protection 
information object in a PATH message. FIG. 3B is an illustrative format for an SRLG list 
in a service path information object in a PATH message. 

[0010]. FIG. 4 is a flowchart of processing performed in restoration path setup, in 

accordance with a preferred embodiment of another aspect of the invention. 

[001T}> -Us , ; FIG. 5 is a flowchart of processing performed in path normalization, in 
i ^^^S^fi^y^f^^ preferred embodiment of another aspect of the invention. \ 



[001 2] FIG. 6 is an illustrative format for a NOTIFICATION message, supporting path 

normalization. 

[001 3] FIG. 7 is a flowchart of processing performed in service path verification, in 

accordance with a preferred embodiment of another aspect of the invention. 

[0014] FIG. 8 is a flowchart of processing performed in path deletion, in accordance 

with a preferred embodiment of another aspect of the invention. 

[001 5] FIG. 9 is an illustrative format for a PATHTEAR message, supporting shared 

restoration. 



Detailed Description 



[0016] FIG. 1 is a diagram of a label switched network 1 00. The nodes 110, 112, 

1 1 5, 1 20, 1 22, 1 25, 1 30, 1 35 of the network 1 00 are arranged in a mesh topology 
illustrating the sharing of restoration bandwidth across multiple independent failures. 

[001 7] A label switched path ("LSP") through the network 1 00 is established using 

the exchange of label distribution messages between adjacent nodes. See P. Ashwood- 
: Smith, et al., "Generalized MPLS — Signaling Functional Description," IETF Network 




protocols — namely RSVP-TE and CR-LDP. See, e.g., L. Berger, et al., "Generalized MPLS 
Signaling — RSVP-TE Extensions," IETF Network Working Group, Internet Draft, 
http://www.ietf.org/internet-drafts/draft-ietf-mpls-generalized-rsvp-te-00.txt 
(November 2000); and P. Ashwood-Smith, et al., "Generalized MPLS Signaling — CR- 
LDP Extensions," IETF Network Working Croup, Internet Draft, 
http://www.ietfeor9/internet^ 

(November 2000); which are incorporated by reference herein. See also, D. Awduche, et 
al., "RSVP-TE: Extensions to RSVP for LSP tunnels," IETF Network Working Group, Internet 
Draft," http://www.ietf^org/intem 

2006); - arid B: Jamoussi, et al., "Constraint-Based LSP Setup using LDP," IETF Network 
Working Group, Internet Draft, http://wvyvy.ietf.org/internet-drafts/draft-ietf-mpls-cr- 
jdp-04.txt : ()uly 2000)* which are incorporated by reference herein. The present 
invention shall be described herein for illustration purposes with particular reference to 

signaling messages. ' 

[001 8] .>;...;../; A restorable LSP in a transport network supporting shared mesh restoration 

P a *h anc * a restoration (secondary) path. During normal 



Mtwd^ failures), the LSP is established along the service path, with 




resources (optionally) reserved along the restoration path. With reference to FIG. 1 , 
consider an LSP established between node 1 1 0 and node 1 1 5, and another between 
node 1 20 and node 125. The service and restoration paths for the LSP between 1 1 0 and 
1 1 5 are 11 0-1 1 2-1 1 5 and 1 1 0-1 30-1 35-1 1 5, respectively, whilst the service and 
restoration paths for the LSP between 120 and 125 are 120-122-125 and 120-130- 
135-125, respectively. Thus, the link between nodes 130 and 135 has capacity reserved 
for the failure of both the service paths. If the service provider wishes to guarantee 
recovery from any single failure event, and if the links along the two service paths do 
not have any common failure, then a single unit of capacity may be reserved on the 
1 30-1 35 link for the restoration of either of the service paths assuming one unit of 
bandwidth for each LSP. 

[001 9] When the amount of reserved capacity on each link is a function of the LSPs 

that are to be restored on the link, signaling is required to reserve this capacity along 
the restoration path. 

[0020] 

[0021] A. RESTORATION PATH RESERVATION 

[0022] In implementing shared mesh restoration, we assume there is a single pool 

of bandwidth capacity on each link for both service paths and restoration paths. Then 

during LSP 
shared 

illp^ paths are not expected to fail. 

:? ^ % v sin^ltaneously: The restoration capacity might be either idle or used for pre-emptable 
; - LSPs, The amount of restoration capacity reserved on the restoration paths determines 
- the robustness of the restoration scheme to failures. For example, a network operator 

may choose to reserve sufficient capacity to ensure that all restorable LSPs can be 
recovered in the event of any single failure (e.g., a conduit being cut). A network 
operator may instead reserve more or less capacity than that required to handle any 
single failure event, or may alternatively choose to reserve only a fixed pool independent 
of the number of LSPs requiring this capacity. 

V ; * . [0023] ^ # V> FIG . 2 is a flowchart of processing performed in resource reservation for 

,vV:;s\ restoration in a mesh network, in accordance with a preferred embodiment of this 
^tjV ^ ^ FIG. 2 illustrates hovv extensions to RSVP signaling messages 

" 1 ~: A ^f" ^^ran us^cffd implement resource reservation for shared mesh restoration. It is 
^ ^ assumed that, given GMPLS routing enhancements (see K. Kompella et al. f "OSPF 

MPLS," IETF Network Working Group, Internet 
, * 5 .«, Draft; http://www.ietf.org/internet-drafts/draft-kompella-ospf-gmpls-extensions- 
.(February 2001); K. Kompella et al., "IS-IS Extensions in Support of Generalized 
Network Working Group, Internet Draft, http://www.ietf.org/internet- 






drafts/draft-ietf-isis-gmpls-extensions-02.txt (February 2001)), each node will have a 
representation of the transport network topology, including the available capacity, 
capacity in service, and capacity reserved for restoration on each link. . While a network 
operator wants to protect against any link failures, it is desirable to know the set of links 
used along the service path when reserving capacity on the restoration path. 
Alternatively, if it is desired to protect, more generally against what is referred to in the 
art as "shared risk link group" (SRLG) failures, the setup message should convey, when 
restoration capacity reservation is calculated along the restoration path, information 
about the SRLGs that are associated with the service path should be provided. In 
guaranteeing recovery from a single SRLG failure, two restoration paths can share 
resources if the corresponding service paths have no SRLG in common. In general, 
carriers will want to protect their network against at least any single failure event, such 
as a fiber cut, or a conduit cut. The SRLG concept may be generalized to represent a 
fiber, a node, or a conduit. Thus, for simplicity in the following description, it is 
assumed that the network operator is protecting against SRLG failures. 

[0024] With reference to FIG. 2 f when a restorable LSP request arrives,, the source 

node calculates the service and restoration paths for the LSP at step 201 . As alluded to 
above, it is advantageous for the two paths to be SRLG diverse. A conventional RSVP 
PATH message is sent along the calculated service path to establish the service path. To 
satisfy SLAs, the network may reserve resources along the chosen restoration path. To 
achieve th is ^t jtf ^jrce ^jpde at a step 202^sends^a^ PATH message along the restoration 
V . path yvitfr a "shared reservation" flag requesting a shared reservation along the path. 

[002^ ': T - . r FIG- 3 set forth an advantageous format for the PATH message. To \ f 
implement restoration resource reservation for shared mesh restoration, a new 
mechanism must be introduced into PATH messages to distinguish between service path 
establishment, reservation of shared resources, or allocation of shared resources to a 
restoration path. The GMPLS signaling specifications currently define protection 
information object used in the LSP setup procedure. This protection information object 
is carried in a'newobject/TLV that includes a bit flag that indicates whether the LSP is a 
primary (service) path or a secondary (restoration) path. GMPLS also specifies a "Link 
Flags" field in the protection information object. The Link Flags field indicates the link 
protection type desired by the LSP. If a particular type is requested, the LSP request is 
processed only if the desired link protection type can be honored. FIG. 3A sets forth a 
new advantageous format for the protection information object. The S (secondary) bit in 
the protection information object, as shown in FIG. 3A f may be used to indicate that the 
LSP establishment is for a restoration/secondary path — not a service path. The shared 
„.■;...- resource reservation and shared resource allocation can be explicitly indicated through a 
new "Shared Reservation" flag in the protection information object. The Shared 
Reservation (R) flag may be encoded as follows: 





• "1" = reservation 

If other flags are needed to support restoration, the shared reservation flag can be 
included in a "Path Flags" field. The protection information object would be used in the 
PATH/RESV message forwarded along the restoration path during restoration path 
resource reservation and resource allocation. 

[0026] The nodes along the restoration path need to know the path taken by the 

service path so that reservations can be shared among multiple restoration paths whose 
service paths are SRLG-disjoint. Thus, the PATH message sent along the restoration 
path should include information about the service path. This information is 
communicated by introducing a new object, referred to by the inventors as the "service 
path information object" in the PATH message. There are two advantageous alternatives 
for the information that might be conveyed in the service path information object: 

• (1)LINKJJSTSERVICE_PATH INFORMATION object. The information can 
contain a list of the links along the service path. A LINK.LIST SERVICE.PATH 
INFORMATION object can be defined which denotes the set of TE links that are used 
along the service path. This information can be used directly when restoration 
bandwidth reservation accounts for link failures only. If SRLC failures in the restoration 
reservations are accounted for, then the use of the LINK.LIST requires the nodes along 
the restoration path to map from links to SRLGs. 

• (2) SRLG.LIST SERVICE.PATH INFORMATION object. Alternatively, the 

. information can contain a list of the SRLGs traversed by the service path. If SRLG . 
" V ^ reservations are accounted for, then carrying the LINK.LIST 

the restoration path would require that every . 
\1' v ""■■"J*' T^hc^Tdu^fute the calculation of the associated set of SRLGs for the links along the 

service path. This calculation could instead be performed only at the source node, with 
the set of SRLGs then carried in the PATH message. Thus, it is advantageous to define a 
SRLG.LIST SERVICE.PATH INFORMATION object. The SRLG.LIST carries the list of SRLGs 
that are used by the service path. FIG. 3B shows how the information could be carried in 
the SRLG.LIST. Each SRLG in FIG. 3B is defined as a 32-bit unsigned number. In this 
SRLG list, theWe?"6f ^ is not significant. 

The use of the SRLG.LIST is more straightforward and requires less processing at each 
node than the LINK-LIST. The LINK. LIST, however, in some realistic topologies, may be 
; _ significantly shorter. 

" I [0027} ? v- Accordingly, with reference to the message format shown in FIG. 3, shared 
Vestoration resource reservation is done if and only if the PATH message includes the 
<SERVICE.PATH.INFORMATION> and the <PROTECTION> objects with S and R (shared 
...^ ^ v ; reseryat^ the <SERVICE_PATH_INFORMATION> is ignored and 

message processing is performed as usual. Shared restoration resource allocation is 
; > : - done if and only If the PATH/RESV message includes the <PROTECTION> object with S 



[0028] Thus, with reference again to FIG. 2, an RSVP PATH message containing a 

protection information object with the S and R (shared reservation) bits set is forwarded 
along the restoration path with information that identifies the SRLCs of the service path 
at step 202. This information, as described above, may be conveyed using either the 
LINK_LIST or the SRLG.LIST. Upon receipt of this message, at step 203, each node 
should then update the restoration bandwidth reserved on the outgoing links of the 
restoration path. Assume that each node maintains a Reservation array Rj[i], i=l,2,...,K, 
for each adjacent link j, where K is the maximum SRLC index. Rj[i] indicates the 
bandwidth required on the link j if the i-th SRLG in the network fails. The total reserved 
restoration capacity on link j should be calculated as the maximum over all SRLGs (i.e., 

max Rj[i], i=l ,2 K ). When a node receives a new reservation message, it saves state 

relating to the LSP and updates the Reservation arrays on its link(s) in the following way: 
Rj[i]=Rjti] + reservation bandwidth if the i-th SRLG is in the SRLGs associated with the 
<SERVICE_PATHJNFORMATION> object. Once Rj[i] has been re-calculated for all SRLGs 
associated with the service path, a new required reserved capacity is calculated (i.e., 
max Rj[i]=l ,2,...,K). If at step 204 inadequate capacity is available to support this new 
resource reservation, the LSP reservation process may be abandoned, with an error 
message (PATHERR) being returned to the source at step 206. The already reserved 
resources must then be removed. However, if the reservation is successful and the 
reserved capacity has changed as a result of this new LSP reservation, then updated link 




[0029] 1^ .,- —Similarly, when a node receives a message requesting the removal of 

" reservations for an existing restorable LSP, the reserved restoration capacity along the 
restoration path is updated : Rj[i] = Rj[i] - reservation bandwidth if the i-th SRLG is in the 
set of SRLGs along the service path. Again, this update may result in a change in the link 
information that is flooded throughout the network. 



[0030] Accordingly, the PATH message sent along the pre-calculated restoration 

path reserves the required restoration resources and creates shared reservation state 
relating to the LSP without cross-connecting the channels. A RESV message with the 
i same flag can be returned to acknowledge the resource reservation along the 
; restoration path without establishing the restoration path. 

[0031] In general, depending on the network operator's desired functionality, 

- channel selection may be performed either during the reservation stage, or after failure.- 
If channel channel selection is stored during the resource 

reservation phase as part of the reservation state along the LSP's restoration path. 
Importantly, although the channels are pre-selected, the cross-connect is not 



phase, then restoration message processing during restoration may be faster. However, 
if the pre-selected channels are dependent on the failure scenario, channel pre- 
selection may necessitate that fault isolation be performed before connectivity can be 
restored. Moreover, it is only possible to pre-select channels for a specific set of 
anticipated failures; if other failures occur, channels must in any event be selected after 
failure. 

[0032] Alternatively, channel selection may be performed after failure on receipt of a 

signaling message for restoration. In this case, since restoration capacity along the 
restoration path is only reserved but not allocated, handling a fault translates into 
allocating the restoration path after failure. This requires efficient mechanisms for 
triggering and allocating the restoration path to meet the tight restoration timing 
constraints. The LSP restoration time will depend on the time to detect the failure, 
(possibly) localize the failure, notify the node(s) responsible for restoration, and finally 
activate the restoration path. 

[0033] 



[0034] 



B. RESTORATION PATH SETUP 



[0035] Failure detection and localization are technology and implementation 

~ dependent, and, accordingly, the present invention is intended to work independent of 
eUk- the mechahisnn^usecLfo^failure localization and notification. In general fi failures are ; 




; ; appropriate action: Restoration path setup can be triggered in many different ways — " 

. '3: yi./.t * |: .:^,~:T f /"^ - ------ ... . ..... 



and at either the source node or destination node/ or both. 



[0036] FIG. 4 is a flowchart of processing performed in establishing the restoration 

^ path after failure, in accordance with a preferred embodiment of this aspect of the 
invention. At step 401 , the restoration path setup trigger is received, at either the 
; ■ 7 source oPd¥sT^^ service path fails, the restoratioiTpath should be 

established using the reserved restoration bandwidth on each link. If the restoration 
V initiated by the source/the source node at step 402 sends a PATH message 

^ "^'1^9.^? restoration path with the "shared reservation" flag not set, indicating that the / 
?* • restoration path should now be established. This is accomplished by sending a PATH 
; ^ y ^fft jg s ^e iricriidjng the <PROTECTION> object with S bit set and the R bit not set. Since 
nodes along the path retained reservation state for the restoration path, this state can 
: i be used to ensure that restoration paths allocate resources out of the capacity reserved 
;^:fdr ; restorationrUpon receipt of the PATH message, at step 403, the nodes along the 

restoration path should check the cross-connect state for this path. (This is needed in 
y}& caise restoration triggered from the destination node has already performed the cross-, 
^^nnectidri.) Jf the : cross-connection has not been performed,, at step 404, then the 





node should select channels (if not already pre-selected), and perform the required 
cross-connections at step 405. In nodes with significant cross-connect switching times 
(e.g., MEMS cross-connects) it is important to have the PATH message be forwarded 
without waiting for the cross-connection to be completed, as set forth in step 406. The 
destination node sends a RESV message to the source to acknowledge the successful 
establishment of the restoration path. 

[0037] If the signaling is initiated by the destination, then at step 402 a RESV 

message is sent along the restoration path with the "shared reservation" flag not set. 
The RESV message is sent from the destination including the <PROTECTION> object 
with S bit set and the R bit not set. Upon receipt of the RESV message, at step 403, the 
nodes along the restoration path should check the cross-connection states for this path. 
If the cross-connection has not been performed, at step 404, then the node should 
select channels (if not already pre-selected), and perform the required cross- 
connections at step 405. In nodes with significant cross-connect switching times (e.g., 
MEMS cross-connects) it may be important to have the RESV message forwarded without 
waiting for the cross-connection to be completed, as set forth in step 406. The source 
node sends a RESV_CONF message to the destination to acknowledge the successful 
establishment of the restoration path. 

[0038] If both ends initiate restoration, the PATH and RESV messages for the same 

restoration path may meet at an intermediate node, as set forth in step 407. This may 
resuIMn label contention. For a uni-directional LSP, the contention is resolved using •->-;-'■■ 
: For a bi-directional LSP. the contention is resolved J)ised^ 

forGMPLS; Ate^ 

can be resolved using the methods disclosed in co-pending commonly-assigned Utility 
Patent Application, "METHOD FOR UNIDIRECTIONAL AND BIDIRECTIONAL LABEL 
SWITCHED PATH SETUP IN A LABEL SWITCHED NETWORK," Serial No. 1 0/063,923, filed 
1 on May 24, 2002, which is incorporated by reference herein. When signaling messages 
from the two ends meet at an intermediate node, the node sends a RESV message to the 
source and RESV!CONF ttf the destination in response to the establishment-of the 
restoration path. 

[0039] r When restoration is triggered from both source and destination, and 

PATH/ RESV messages are forwarded without waiting for cross-connection as described 
abbye, the receipt of the RESV or RESV_CONF does not guarantee the success of 
restoration path establishment. In this case, a subsequent error message may override 
the acknowledgment. 




[0042] In shared mesh restoration schemes, the reserved restoration resources are 

limited. During a restoration path establishment, there may be scenarios in which the 
restoration path can't be setup, for example, if there aren't adequate reserved 
restoration resources or if there is a failure along the restoration path. In this case, 
PATHERR and RESVERR messages may be used to report the failure of restoration path 
establishment. It is important that any resources allocated by the incomplete restoration 
path establishment be immediately released such that these resources can be used for 
other restoration paths. In the RSVP-TE extensions proposed for GMPLS, the PATHERR 
message was extended to carry a "state.remove" flag to release the resources consumed 
by incomplete LSP establishment. In shared mesh restoration schemes, it is possible to 
define a new flag "allocation_remove", which could be carried in both PATHERR and 
RESVERR messages. Upon receipt of PATHERR or RESVERR messages with this 
"allocation_remove" flag, the node does not remove all local state but instead 
advantageously frees the cross-connect resources and releases the channels to the 
reserved capacity pool. 

[0043] 

[0044] D. NORMALIZATION 

[0045] After service path repair, it is generally desirable to normalize the LSP back to 

its original service path. Often, the routing of the restoration path may not be as 
ef^te oncea restoration patfr is . \ r r 

-£-0%. MtabHsJhe^th? paths whose restoration paths^i 

^^;<w^ unless the other restoration routes are re^£*£ 

calculated. Reverting back to the service path after a failure is repaired requires that the 
service path's resources remain allocated during the time that the LSP uses restoration 
resources. For RSVP, techniques must be developed that allow service path resources to 
^ I remain allocated even though refreshes may be affected by failed signaling channels. 
Moreover, it is important to have mechanisms that allow LSP normalization to be 
performed withouLdisrupting service to the customer. . . :0 . ,. ¥ ^ mmm . 

[0046] In accordance with a preferred embodiment of another aspect of the 

invention, FIG. 5 sets forth a flowchart of processing performed in path normalization 
that, advantageously, avoids service traffic interruption during the normalization 
process. At step 501 , it is preferable that the service path by verified after repair. At 
vr step 502, the source node commences the process by "bridging" the customer signal., 
* onto both the service and restoration paths (the "bridge" function sends the customer 
input signal to both paths). Once the bridge process has completed, at step 503, the 
^ "source hode^elicfs a Notification message to the destination, requesting that the 
destination "bridge and roll" the service and restoration paths (the "roll" function 
l ; switches the signal sent to the customer from restoration path to service path). In this . 
case^h select the service path signal at step 



504. Upon finishing the bridge and roll at the destination, at step 505, the destination 
sends a Notification message to the source confirming the completion of the bridge and 
roll operation. When the source receives this Notification, at step 506, it stops 
transmitting traffic along the restoration path, and, at step 507, sends another 
Notification message to the destination confirming that the LSP is normalized. Once the 
destination receives this Notification message, at step 508, it issues a RESVTEAR 
message along the restoration path and stops transmitting along the restoration path at 
steps 508-509. The RESVTEAR message informs the nodes along the restoration path 
to release the restoration resources if shared restoration is used for this LSP. This 
procedure achieves the "make-before-break" feature, that is, minimal service traffic 
interruption during the normalization process. Note that the RESVTEAR removes the 
cross-connection for the restoration path (and frees the resources to be used for 
restoring other failures), but does not delete the local state along the restoration path. 
In this case, the RESVTEAR should not trigger a PATHTEAR message from the source 
since we want resources to continue to be reserved for this LSP. This allows the 
termination node to quickly re-establish the restoration path by sending either a RESV 
or PATH message if the service path fails again in the future. The protection object with 
"shared reservation" flag is carried in the RESVTEAR message to suppress the PATHTEAR. 

[0047] It is important to note that this normalization process is applicable to end- 

to-end restoration procedures as well as segment-based restoration procedures (i.e. 



be extended to include a status field describing each of the different steps in the 
normalization process. The NOTIFY message, as shown in FIG. 6, includes the 
<ERROR_SPEC> object, which has four fields: node address, flags, code, and value. Th 
node address represents the address of the node generating the notification message. 
■ • New codes/values*irrthe^<ERROR_SPEC> object could be reserved to support 

normalization. Three new codes/values are needed: (1) a code indicating that bridging 
has been completed; (2) a code indicating that the roll/bridge has been completed; and 
(3) a code indicating that the roll has been completed. The NOTIFY messages can be 
V 7 sent using: re^liable or some other mechanism. 

[0049] // ; \? Additional mechanisms may be required in some cases (e.g., all-optical 
networks) to ensure that intermediate nodes do not alarm due to LOL during the 
teardown procedure. See below, Section C. 

[0050] As set forth in FIG. 5, it is advantageous to permit verification of the service 





patfvafter^ successful repair of the failure and prior to commencing the above 



manages the mesh network. The NMS provides a fault isolation and fault handling 
functions. When a node in the network detects a failure for a connection, it triggers the 
restoration process for the failed connection. The node also sends a failure notification 
message to the NMS. The nodes along the service path retain the connection state 
associated with the service path so that the service path can be normalized following 
failure repair. Otherwise, the service path should be established first without connecting 
to customer signals before normalization process. The fault isolation function of the 
NMS analyzes all failure notification messages, isolates the network failure, and issues a 
trouble ticket to initiate manual repair of the failure. In most cases, a technician will 
have to be sent to the failure site to repair the failure. The technician will report 
successful failure repair to the NMS. The NMS then triggers the restoration 
normalization process for the restored connections. As part of this process, the NMS 
may select a few or all of the restored connections for normalization. In distributed path 
restoration schemes, each connection is restored individually, and each connection can 
be independently normalized without coordination with other connections. In order to 
minimize the risk of having unsuccessful normalizations, it is preferable that each 
repaired service path be verified before the connection is switched back to the service 
path. This normalization / verification of the service path should only occur after the 
technician believes that the failure has been successfully repaired. 

[0051] FIG. 7 sets forth a flow chart of processing performed for verifying the 




between neighboring nodes in GMPLS: See, etg:, J. 
r^V^:^^. Langi et al^tink Management Protocol (LMP),? IETF Network Working Croup, Internet 
•"": , ^-* ; ^>- Draft, http://www Ouly 2001), 

\- 7 which is incorporated by reference herein. One of the functions of LMP is to verify the 

physical connectivity of the data-bearing channels of neighboring nodes. Once LMP is 
^ ^ " implemented in network nodes, it is natural to treat the service path between non- 

neighboring nodes as a link, and use LMP to verify the connectivity of the repaired 
; tv^'v be run between nodes thaTare not 

necessarily physically adjacent. 

V [0052] At step 701, it is assumed that the source node receives a normalization 

message from the NMS. Upon receipt of the normalization message, the source node at. 
^ ~ v , '. step. 702 starts periodic transmission of LMP BeginVerify messages to the destination 
v y ; ^ ^ r node via a signaling network, which provides out-of-band communication among the 
vt ? r network nodes. The periodic transmissions continue until step 703 when the source 

BeginVerifyNack from the destination node, or until the 
Once the destination receives a BeginVerify message, if it is ready to 
procedure, it replies with a BeginVerifyAck to the source 
vi%ne signaling network^ is bi-directional, the destination node 




starts to send TEST messages to the source along the service path at this time. If the 
destination cannot accept the BeginVerify request, it sends a BeginVerifyNack message 
to the source node. If the source node receives the BeginVerifyNack message, then at 
step 704, it informs the NMS of the normalization failure and stops the normalization 
process of this connection. If the source node receives a BeginVerifyAck message at 
step 703, it starts to send Test messages along the service path to the destination at 
step 704. This can be done because LMP assumes that the control processor in a node 
can send and receive LMP messages over any port. Note that in the preferred 
embodiment of the invention, all LMP messages except for the TEST message are sent 
via the signaling network; the TEST message is sent via the service path. Once a node 
receives the Test message, the TestStatusSuccess message is transmitted via the 
signaling network. If no TEST message is received before the timer expires, a 
TestStatusFailure message is transmitted via the signaling network. Upon receiving a 
TestStatusSuccess or TestStatusFailure at step 706, the node should send a 
TestStatusAck message back. After the source node has verified the physical 
connectivity of the service path, at step 707, it sends an EndVerify message via the 
signaling network to the destination node to terminate the path verification process. The 
EndVerify Ack message is sent back by the destination node via the signaling network 
upon receipt of an EndVerify message at step 708. This message acknowledges the 
termination of the path verification process. Note that this service path verification 
process has no impact on the connection itself. The connection is still up on the 
X restoration, path^, After. the service path verification process, if the seryice^path is r : 
+-t -\ X-i physic ve/iflcaFidn was a success), then the normalization process - 

, ^^proce^ ^^^mi> tj?H' & :'- 

[0053] > It should be noted that the present invention, although described with - ) r 
particular reference to LMP, can be readily adapted to other signaling protocols such as 
LDP by one of ordinary skill in the art. 

[0054] 

[0055] L PATH DELETION 

[0056] Once an LSP is no longer required, the LSP service path and its restoration 

path reserved resources should be released for future traffic. A PATHTEAR message or 
; RESVTEAR message as defined in the CMPLS signaling specification is used to remove 
(de-allocate) the paths. If the source node initiates the LSP deletion, it should send two 
PATHTEAR messages to the destination node: one along the service path and the other 
along the restoration path. The PATHTEAR along the restoration path should include 
* " ihfon^aticirt liBSuTthe service path. The information can contain either a list of the links 
along the service LSP, or a list of the SRLCs traversed by the service path. If the 
V destination initiates the LSP deletion, it should send two RESVTEAR messages to the 





source. The RESVTEAR along the restoration path should include the information about 
the service path. 

[0057] FIG. 8 sets forth a flowchart of processing performed in releasing the 

reserved restoration resources and any allocated resources along the restoration path. 
At step 801, the source/destination sends a PATHTEAR/ RESVTEAR message along the 
restoration path, including the <SERVICE_PATHJNFORMATION> object. Upon receipt of 
this message, at step 802, each node along the restoration path should de-allocate any 
resources allocated to this LSP (e.g., if the LSP is currently using the restoration path) 
and decrement the reserved resources accordingly. FIG. 9 sets forth an advantageous 
format for the PATHTEAR message. The RESVTEAR message can be specified in an 
analogous manner. 

[0058] It is important that valid signaling actions for planned events — e.g., LSP 

deletion — do not appear as failures along the path. Additional mechanisms may be 
required in some cases (e.g., all-optical networks) to ensure that nodes do not alarm 
due to LOL during the teardown procedure. If LSPs are deleted in an all-optical network 
by sending a single deletion message, LOL resulting from disconnection at a node will 
propagate down the path faster than the LSP deletion message, potentially triggering 
restoration. Thus, for planned events that could result in LOL along the path, such as 
LSP deletion, all nodes must be informed of the upcoming event so that they may turn 
off alarms corresponding to the desired LSP so as not to initiate restoration. 

: [0060] 

[0061] Restoration techniques can be classified into path-based and link-based: 

wherein "path-based" schemes are implemented via an alternate or restoration path that 
may traverse multiple nodes in contrast with "link-based" techniques wherein traffic is 
switched to an alternate channel or link connecting adjacent nodes. In general, path- 
based schemes'm^ path, a segment or a link. The present 
invention, it should be noted, is applicable to all of these cases, although the above 
detailed description focuses primarily on end-to-end path-based restoration. 

[0062] ; " The foregoing Detailed Description is to be understood as being in every 
respect illustrative and exemplary, but not restrictive, and the scope of the invention 
disclosed herein is not to be determined from the Detailed Description, but rather from 
the claims as interpreted according to the full breadth permitted by the patent laws. It 
is to be understoodjhat the embodiments shown and described herein are only 
illustrative of the principles of the present invention and that various modifications may 
be implemented by those skilled in the art without departing from the scope and spirit 
M^^^^W^M^^^^iori. For example, the detailed description describes an embodiment of the 



invention with particular reference to extensions to RSVP-TE. However, the principles of 
the present invention could be readily extended to other signaling protocols such as 
CR-LDP. Such an extension could be readily implemented by one of ordinary skill in the 
art given the above disclosure. 



